Feature construction using explanations of individual predictions

نویسندگان

چکیده

Feature construction can contribute to comprehensibility and performance of machine learning models. Unfortunately, it usually requires exhaustive search in the attribute space or time-consuming human involvement generate meaningful features. We propose a novel heuristic approach for reducing based on aggregation instance-based explanations predictive The proposed Explainable Construction (EFC) methodology identifies groups co-occurring attributes exposed by popular explanation methods, such as IME SHAP. empirically show that these significantly reduces time feature using logical, relational, Cartesian, numerical, threshold num-of-N X-of-N constructive operators. An analysis 10 transparent synthetic datasets shows EFC effectively informative constructs relevant Using 30 real-world classification datasets, we significant improvements accuracy several classifiers demonstrate feasibility even large datasets. Finally, generated interpretable features problem from financial industry, which were confirmed domain expert.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Explanations, Predictions, and Laws

CARL G. HEMPEL '-Fb v Ga v Ha'. Kim shows generally that his additional requirement blocks the proofs offered by Eberle, Kaplan, and Montague for the five theorems that "trivialize" the defintions (7.8) and (7.9). However, it would be desirable to ascertain more clearly to what extent the additional requirement is justifiable, not on the ad hoc ground that it blocks those proofs, but in terms o...

متن کامل

Interactive Feature Space Construction using Semantic Information

Specifying an appropriate feature space is an important aspect of achieving good performance when designing systems based upon learned classifiers. Effectively incorporating information regarding semantically related words into the feature space is known to produce robust, accurate classifiers and is one apparent motivation for efforts to automatically generate such resources. However, naive in...

متن کامل

Consensus-Based Modelling using Distributed Feature Construction

A particularly successful role for Inductive Logic Programming (ILP) is as a tool for discovering useful relational features for subsequent use in a predictive model. Conceptually, the case for using ILP to construct relational features rests on treating these features as functions, the automated discovery of which necessarily requires some form of first-order learning. Practically, there are n...

متن کامل

Genetic Algorithm Based Learning Using Feature Construction

Genetic algorithms (GAs) are excellent for learning concepts that span complex space, especially those with a large number of local optima. Learning algorithms, in general, perform well on data that has been pre-processed to reduce complexity. Several studies have documented their effectiveness on raw as well as pre-processed data using feature selection, etc. Unlike other learning algorithms (...

متن کامل

Explanations of model predictions with live and breakDown packages

Complex models are commonly used in predictive modeling. In this paper we present R packages that can be used to explain predictions from complex black box models and attribute parts of these predictions to input features. We introduce two new approaches and corresponding packages for such attribution, namely live and breakDown. We also compare their results with existing implementations of sta...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Engineering Applications of Artificial Intelligence

سال: 2023

ISSN: ['1873-6769', '0952-1976']

DOI: https://doi.org/10.1016/j.engappai.2023.105823